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Abstract. The little q-Jacobi function transform depends on three parameters. An explicit 
expression as a sum of two very- well-poised sW^-series is derived for the dual transmutation 
kernel relating little q-Jacobi function transforms for different parameter sets. A product 
formula for the dual transmutation kernel is obtained. For the inverse transform the trans- 
mutation kernel is given as a 3<p2-series, and a product formula as a finite sum is derived. The 
transmutation kernel gives rise to intertwining operators for the second order hypergeomet- 
ric g-difference operator, which generalise the intertwining operators arising from a Darboux 
factorisation. 



1. Introduction 

The Jacobi transform is an integral transform on the positive half-line with a hy- 
pergeometric 2-^1-series as its kernel. This transform is a two-parameter extension of the 
Fourier-cosine transform and the Mehler-Fock transform, and also contains the Hankel 
transform as a limit case. The inversion formula for the Jacobi transform can be found ex- 
plicitly in several ways, using asymptotics, spectral analysis, group theory or intertwining 
properties. This transform has a long history and we refer the reader to the survey paper 
[13] by Koornwinder. 

There are several levels of (/-analogues of the Jacobi function and of the corresponding 
transform pair, see [9] for an overview and references. Here we consider the so-called little 
q- Jacobi function and the corresponding transform. The little q- Jacobi function transform 
has been studied by Kakehi, Masuda and Ueno [7], [6] as the (spherical) Fourier transform 
on the quantum SU(1,1) group using the interpretation of the little q- Jacobi functions 
as matrix elements of unitary irreducible representations of U q (su(l,l)), see [14]. On 
the other hand the little q- Jacobi function transform occurs when studying the action 
of so-called twisted primitive elements in the principal unitary series representations of 
U q (su(l, 1)), and this has been the motivation for the study of this paper. However, the 
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paper is completely analytic in nature, and the quantum group theoretic interpretation is 
only discussed briefly in §6. 

The little (/-Jacobi function transform can be obtained from the spectral analysis of 
the second order hypergeometric (/-difference operator 

(1-1) L = = a 2 (l + I) (T q - Id) + (1 + ^) (T- 1 - Id) , 

where T q f(x) = f(qx), on a suitable Hilbert space, see Kakehi [6] or [8, App. A], where 
a slightly more general result is given. So we have eigenfunctions to L in terms of basic 
hypergeometric series, see [4, Ch. 1]. The little (/-Jacobi function is defined as 

, v , / , \ f aa,a/a bx\ 1. 

(1.2) (px{x;a,b;q) = 2 <Pi I & -— J, X = -{a + a ). 

The notation for (/-hypergeometric series follows Gasper and Rahman [4], and we assume 
< q < 1; 

1.3 fc+i^fc , , ; » ^ J = — t — r z — \ 

V 0i,...,6 fc / ^ (q,^,... ,b k ;q)j 

j-i 

(ai, . . . , ajfc+i; g), = (ai; q)j . . . (a fe+ i; g),-, (a; g),- = JJ(1 - ag*), j G Z> U {oo}. 

i=0 

The radius of convergence is 1 for generic parameters, but there exists a one- valued analytic 
continuation to C\M>i, see [4, §4.5]. 

The little (/-Jacobi function satisfies L(f)\(-; a, b; q) = (—1 — a 2 + 2a\)4>\(-; a, b; q). For 
later use we note that the little (/-Jacobi functions are eigenfunctions for the eigenvalue A 
of 

(L4) £ w> = _L £ <-> + i (o + o = | (1 + i )r , _ £ + _£_ )Id + _L (1 + g^. 

For simplicity we assume that a, 6 > 0, ab < 1 and y > 0, but the results hold, mutatis 
mutandis, for the more general range of the parameters as discussed in [8, App. A]. Then 
the operator L is an unbounded symmetric operator on the Hilbert space 7i(a, b; y) of 
square integrable sequences u = (uk)kei with respect to the weights 

(1.5) 2^ ( a& ) 



k= — oo 



{-yq k ;q) c 



where the operator L is initially defined on the sequences with finitely many non-zero 
entries. 

Note that (1.5) may be written as a (/-integral. Indeed, by associating to u a function 
/ on yq z by f(yq k ) = Uk and using the notation, see [4, §1.11], 

roo(y) oo 

(1.6) / f(x)d q x = y /(v<zV> 

JO u- 
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we see that for a = ql( a +l 3 + 1 ) and b = q^ a the sum in (1.5) can be written as 

(1.7) y a / f(x)x a \ Xq \ q> °° d q x, > -1. 

Using the (/-binomial theorem, see [4, §1.3], we see that the quotient of (/-shifted factorials 
in (1.7) tends to (1 + x)^ as q tends to 1. In the paper we will use the correspondence 
between u G Ti(a,b;y) and functions / given by f(yq k ) = u k repeatedly. 

The spectral analysis of L, or equivalently C^ a,b \ on 7i(a,b;y) can be completely 
carried out, and this leads to corresponding transform 

{F aAy u){\)= £ u k MyQ k -,a,b;q)(ab) k { - bmk l a \ qU ^ 

(1.8) fc =-°° M ' 



u k = / (J r a,b, y u)(\)(j)\(yq k ;a,b;q)dv(\;a,b]y;q), 

JR 



for an explicit measure dv(-;a,b;y;q) described in (1.10). Here we use the one-valued 
analytic continuation of the 2^1-series. Then T = J~ a ,b,y extends to an isometric operator 
from TC(a, b; y) onto L 2 (du(-; a, 6; y; q)). 

The goal of this paper is to establish a number of links between two little g-Jacobi 
function transforms for different parameters (a,b,y). Our main interest lies with the dual 
transmutation kernels P satisfying 

(1-9) (Fc^yfttu])^) = / (j 7 cA yu)(X)P t (X,n)di^(X;a,b;y;q), 

Jr 

where (dtu)k = t k Uk for an extra parameter t. Note that the kernel P is analogous to 
a non-symmetric Poisson kernel, and to a Poisson kernel for (a, b) = (c,d), for a family 
of orthogonal polynomials. In our main result, Theorem 2.1, we present an explicit ex- 
pression for the kernel in case ad = be. The result is much inspired by Mizan Rahman's 
summation formulas [8, App. B]. We similarly study the transmutation kernel P for the 
inverse transform, 

( 1 a _ f (T -i n p , . k (-byq k /a;q) oc 

fc=-oo 1 Vq > q>QO 

An explicit expression for the transmutation kernel is obtained in case dx = by in Theo- 
rem 2.2. For the transmutation kernels we show that these kernels do indeed satisfy the 
transmutation property, i.e. they intertwine the second order (/-difference operator £( a > & ) 
for different parameters (a, b). This is closely related to results on (/-analogues of Erdelyi's 
fractional integrals recently obtained by Gasper [3], and we give new proofs of some of 
his main results using the little (/-Jacobi function transform (1.8). The main results are 
formulated in §2. The proofs of the statements are contained in §3, §4 and §5, where 
in §3 we prove some summation formulas, amongst others an extension of Ramanujan's 
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i^i-summation, that are of independent interest. In the final §6 we discuss some of the 
quantum group theoretic interpretations of these results. 

The little g-Jacobi functions may also be considered as (/-analogues of the Bessel 
function, see [9] for further references. It would be interesting to see if the (generalised) 
transmutation kernels can be evaluated also for other entries in the Askey- Wilson function 
scheme as described in [9]. 

We now give the precise form of the spectral measure dv in (1.8). The measure can 
be obtained from the c-function expansion for the little g-Jacobi function, see Kakehi [6] 
or [8, App. A], analogously to the case of the Jacobi transform. Explicitly, 

<p x (yq k ;a,b;q) 

(l.io) 

c(a;a,b,y;q) 

valid for a 2 q z . Then is the asymptotically free solution; L<& a (-; a, b; q) = (—1 — a 2 + 
2aA)$o-(-; a, b; q) on yq z with, as before, A = \(a + a -1 ). The measure dv in (1.8) can be 
obtained from (1.10), see [6], [8, App. A]. For this we now assume that a > b, which we 
can do without loss of generality, cf. Lemma 5.2 and (5.8). Explicitly, we have 

(l-H) ^ / /(A) dv(\; a, k r,l) = -^ [ /(COS0) w{e») d0+ 

kEZ>o,\aq k \>l ke1,\q 1 ~ k /by\>l 

(ab, ab, -by /a, -aq/by, -y, -q/y; <?)oo, 

(^ 2 ^~ 2 ;q)oo 

(az, a/z, bz, b/z, -byz, -q/byz, -by/z, -qz/by; q)^ ' 

1 ~ a 2 Q 2h (a 2 ,ab; q) k , ^ _ k (q~ 2 ;q)qq 

1-a 2 (q,aq/b;q) k (q, ab,b/a, -aby, -q/aby, -by /a, -aq/by; q)^ 

(g--l)Q- fc(fc - 1) (97^V) fc - 1 
(<?, 3, -Q 1 ~ k /y^ -aq 1 ~ k /by, -b 2 yq k ~ x , -abyq^ 1 ; q)^ ' 

Note that the integral plus the first sum and the sum over — Z> in the second sum can be 
written as dm(X; a, b, — by, —q/by \ q), where dm(-; a, b, c, d\q) denotes the standard (non- 
normalised) Askey- Wilson measure, see [2], [4, Ch. 6]. So the measure in (1.11) has an 
absolutely continuous part supported on [—1, 1], and for a < 1 there are no other discrete 
mass points in dv apart from the infinite series tending to — oo, see [6], [8, §5], [9]. It 
should be observed that (1.8) can be formally obtained from the limit transition of the 
Askey- Wilson polynomials to the little g-Jacobi functions, see [9, §§2.3, 4.1, 6.1]. 



= c(a; a, b; q)$ a (yq ; a, b; q) + c(a ; a, b; q)® a -i(yq ; a, b; q), 



= (aa) Svi 



aa, qa lb 
2 



A-k 



qa* y 
(fr/q, a/q^oo {-bya, -q/bya; q)^ 
(a- 2 , atyq)^ (-by/a,-qa/by;q) 00 ' 



where 

C = 
w(z) = 

w k = 

Vk = 
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Later in this paper, especially in §3, we use the notation for very-well-poised series, 
cf. [4, §2.1]; 

Win -a a • n A - V 1 - ^ gllllU gl±li 

r+ i W/ r ^ai, a 4 , . . . , a r+ i, q, z) — > — — 

~ 1-ai (g,gai/a 4 ,... ,gai/a r+ i;5)j 

(1.12) 

/ ai , q^/a{, -qy/al, a 4 , . . . , a r+i 
V VaT, - vol, «?ai/a 4 , . . . , <?ai/a r+ i 

Acknowledgement. The main research for this paper was done while the second author was 
employed by Technische Universiteit Delft. 

2. Statement of main results 

In this section we describe the main results of the paper. We start with the dual 
transmutation kernel for the little g-Jacobi function, i.e. we want an explicit expression 
for 

Fa,b,y [k i-> t k (j)^(xq k ; c, d; q)] (A) 



k 

oo 



= ]T (abt) k cf>„(xq k ; c, d; q)Uyq k ; a, b; q) ( ^ 

(2.1) (-yq h ;q)^ 

E, (ct,c/t k dx\ (bo,bjo k 

fc= — oo 



using (1.8) and Heine's transformation formula [4, (1.4.6)]. Here A = |((T + a x ) and 
= |(r + r _1 ). In general we do not have an explicit expression, but we have the 
following theorem, which will be proved in §3. 

Theorem 2.1. Let a > b > 0, ab < 1, y > 0. Define the dual transmutation kernel 

P t (X, n q a ] a, b) = F aAy [k » t k ^(yq k ; aq a , bq a ; q)] (A), 

then, using the notation A = \{a + cr _1 ) and \i = \{t + t _1 ) with \a\, |r| > 1, the series 
defining Pt by (1.8) is absolutely convergent for \abq a o~T\ < \abt\ < 1. For \t\ > q/ab, 
t a 2 q 2a+z ^° , t b 2 q 2a + z >o > p t can fr e expressed explicitly as 

Q _ (ba ±l , bq a T ±x , aq^a^/t, aq a r ±1 /t, q, -yabt, -q/abyt; q)^ 
^ Q ' a ' } ~ (ab, abq 2 <*, b/a, q-a^r^/t, a 2 q 2 «/t, abt, -y, -q/y; «,)«, 

x 8 W 7 (a 2 q 2a - 1 /t; aq Q V* 1 , aa ±1 , abq 2 *' 1 / % q, q/abt) 

(acx ±1 , aq a T ±1 ,bq 2a a ±1 /t, bq a T ±x /t, q, -b 2 yt, -q/b 2 yt; q)^ 
+ (ab, abq 2a , a/b, q a a ±1 r ±1 /t, b 2 q 2a /t, abt, -by /a, -qb/ay; q)^ 

x 8 W 7 {b 2 q 2a - x lt; bq a T ±x , ba ±x , abq 2a ~ x ft; q, q/abt) . 
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The expression for the dual transmutation kernel remains valid for A a discrete mass point 
of the measure dv(-;a,b;y;q) as defined in (1.11). Moreover, for q a \r\ < \t\ < 1/Vab and 
qP~ a \tp\ < \s\ < tq~ 2a I 'y/ab, where v = + \p\ > 1, the product formula 

P 8 (/jl, v; q p ; aq a , bq a ) = / P g2Qs/t (A, v; q a+(3 ; a, b)P t (X, fj,; q a ; a, b) dv(\; a, b; y; q) 

Jm. 

is valid. 

As remarked in §1 the little g-Jacobi functions can be obtained as a limit of the Askey- 
Wilson polynomial. In this limit transition one of the parameters tends to zero and another 
one of the parameters tends to oo exponentially. This case is not considered in Askey et 
al. [1, §3], where the non-symmetric Poisson kernel for the Askey- Wilson polynomials 
is derived. Note that the expression [1, (3.9)-(3.11)] is much more complicated than the 
expression in Theorem 2.1. Motivated by the quantum group theoretic interpretation, see 
§6, Theorem 2.1 should be compared to the non-symmetric Poisson kernel for Al-Salam 
and Chihara polynomials, which consists of one very- well-poised 8 WV-series, see Askey, 
Rahman and Suslov [1, (14.8)] and Ismail and Stanton [5, Thm. 4.2]. 

For the transmutation kernel we have the following result. 

Theorem 2.2. Define the transmutation kernel 

P k ,i(a, b, y; r, s) = F~b,y[ X <MW/ s ; ar ' bs '' ^ k 

^\(yq l /s; ar, bs; q)<p\(yq k ; a, b; q) dv(\; a, 6; y; q). 



For r, s > 0, rs < 1, the transmutation kernel is given by 

t (ab,rs,q k - l+1 ,-yq k ;q) OQ ( q l ~ k ,r,ar/b 

P k)l {a,b,y;r,s) = (ab) — n — 3^2 [ ;q,q 



(q,abrs,rsq k l ,—byq k /ar;q) 00 \rs, — arq 1 k /by 

with the convention Pk,i(a,b,y;r, s) = for k < I. Moreover, the transmutation kernel 
satisfies the product formula for r, s,t,u> 0, rs < 1, tu < 1, 

y^P k j(a,b,y;r, s)Pi, p (ar,bs,-;rt, su) (abrs) l <K ybq / ar '^°° = P k ( a ,b,y;rt,su). 

f-^ s {-yq l /s;q)oo 

See (4.7) for the explicit expression for the product formula in terms of the 3</?2-series. 
The resulting product formula is already contained in Gasper [3, (1.7)], and it can also be 
obtained from a general expansion formula [4, (3.7.9) with k = r = t = u = 2, s = 1] due 
to Verma using transformation formulas for 3 </? 2 -series, see also [3, §4]. 

Note that for r = 1 (or s = 1) the transmutation kernel in Theorem 2.2 simplifies; for 
k > I and \s\ < 1 



Pk,i( a > b'V' 1 ' s ) = ( ab ) 



-1 (ab,-yq k ;q) 00 (s;q) k -i 
(abs, -byq k /a; q)^ (q; q) k -i 
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and letting s | 1 gives 



]imP k!l (a,b,y,l,s) = 6 k , l (ab)-'' t " r/ " : ' / ^ 



sTi {-byq k /a]q) 00 

in accordance with (1.5) and (1.8). 

The last main result deals with intertwining operators for the second order (/-difference 
operator as in (1.4). The intertwining properties are also known as transmutation 

properties and for the Jacobi function transform the intertwining operators are known as 
the Abel transform, see [13]. 

Theorem 2.3. (i) Let a, b G C\{0} ; v, \x G C with \q u ~^b/a\ < 1. Define the operator 

(w^(a,b)f)( X ) = ( { ~ x :f°; q-»\±)W 

{-xq ^]q)oo a 



_^_ p , - pu (Q^Q)p fq- p ,q-^-q 1+ ^a/bx i-^ b \ 
>f(xq ) Q -. ^3^2 x _ v _ v u+1/ ;q,q M - 

f-^L {q;q)p V Q p u --q^ +1 /x a J 



oo 

X 

p=0 



for any function f with \f(xq p ) \ = 0(q p ( e+iy ^) for some e > 0. Then W v ^( a -> b) o £( a > b ') - 
£(aq M M ) Q w„^( a i b ) on the space of compactly supported functions and for \ao~\ < q v 

(W„, M (a, &)<M-; a, 6; (/))(y(/ fc ) = y^ ^^ 00 , <Myg*i aq~\ bq~^ q). 

{aq v oM ^cr;?)^ 

(ii) Let a, & > 0, a& < 1, z/ > and fi G C\Z< . Define the operator 



(-6x^ *7 a ;<?)oo 

f ^ M+fc ^ , ,, fc (q iy ,-xq fI ;q) k ( q~ k , ^ , -bxq^~ v /a \ 

2_,f( x Q )( ab ) 7 , rn \ 3V?2 u ;g,g 

[q,-bxqv ;q) k \ q 1 v k ,-xq^ J 



oo 

X 

fc=0 



/or any bounded function. Then C^ aqV ' bq ' o A^ )M (a, 6) = A^ )M (a, 6) o £( a > 6 ) on t/ie space of 
functions compactly supported in (0, oo). Moreover, 

(2.2) (A Vt p(a,b)<l>x(-;a,b;q))(x) = 1 ^ ^ ,0 ° <f> x (x;a<f,b<f;q). 

The operators W„ )A( (ci, b ) an d A u ^( a -> b) are (/-analogues of the (generalised) Abel trans- 
form, see [13, §5]. Note that Theorem 2.3 gives (/-integral representations for the little 
q- Jacobi function and the asymptotically free solution & a of (1.10). 

The 3</?2-kernel of A u ^(a,b) is the same as the transmutation kernel. In order to see 
this we first invert the summation for the 3</?2-series in (2.2) using [4, exerc. 1.4(h)] and 
next transform it using [4, (III. 13)]. Hence (2.2) is equivalent to (4.1). This shows that the 
transform with the transmutation kernel does indeed satisfy the transmutation property. 
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3. The dual transmutation kernel 

The goal of this section is to prove Theorem 2.1. We start with proving some general 
results, which are of independent interest, and come back to the proof of Theorem 2.1 
later. 

We first formulate a general proposition generalising Rahman's summation formulas in 
[8, App. B]. Note that in case the argument of the basic hypergeometric series has absolute 
value bigger than 1, we implicitly use the one- valued analytic continuation to C\M>i. 

Proposition 3.1. Let x,y G C\M>o. Consider the sum 

oo 

s= 

n= — oo 

which is absolutely convergent for max(|ad|, \ae\, \bd\, \be\) < \z\ < 1. If furthermore abde = 
cf , fx = dey, q < \z\, and zj abf ,zj cde £ q z ^° then S equals 

(e, d, c/a, c/b, abd/z, abe/z, af/z, bf/z, q, yz, q/yz; q)^ , abf _ ^ ft / / cf_ q, 

(c, /, c/ab,ae/ z,bej z,ad/ z,bd/ z,abf / z, z^y^q/y^q)^ qz ' ' ' e' a" qz' " z 

(a, 6, / 1 'd, f I 'e,ade/ 'z,bde/ 'z,cd/ 'z,ce/ 'z,q,xz,q/ 'xz^q)^ ,cde c c cf q^ 

(c, /, / /de,ae/ 'z,be/ 'z,ad/ z,bd/ 'z,cde/ 'z, z^x^q/x^q)^ 8 7 qz ' ' ' a ' 6' qz ' ^' z 



a, b 

■q 7 xq 

c 



2<Pl 



d, e 
f 



;q,yq 



Remark 3.2. Using the transformation formulas for very- well-poised series we can find 
more expressions for the sum S, some of which are valid also if one of the conditions 
q < \z\, z/abf,z/cde £ q z ^° is violated, see (3.11), (3.12), (3.13) below. Here we have 
chosen the expression as a sum of two very-well-poised series that shows the symmetries 
(a, 6, c, x) <-> (d, e, f, y), a <-> 6, and d <-> e, which are obvious in the sum. (Note that the 
conditions abde = cf, fx = dey also display this symmetry.) The expression also displays 
the symmetry x <-> y, (a, 6, d, e) <-> (c/a, c/b, f /e, / /d). For the right hand sides this follows 
from abde = cf and fx = dey. For the sum S this follows from a double application of 
Heine's transformation [4, (III. 3)], since fx = dey and abx = cy. 

The following lemma is of use in the proof of Proposition 3.1, and is of independent 
interest. Note that in case k = the series in the summand can be summed by the 
g-binomial formula, and we obtain Ramanujan's i^i-summation formula, see [4, (5.2.1)]. 

Lemma 3.3. For max(|ai|, . . . , |afc+i|) < \ z \ < 1 an d f or x £ C\lR>o we have 



E 



'ai, . . . , a k+1 n \ n (ai, . . . , a k +i, h/z, ... , b k /z, q, xz, q/xz; q) c 
k+Wk\ , , ;q,xq )z - 



h,...,b k J (6i,... ,bk,ai/z, ... ,a k+1 /z, z,x,q/x;q) c 



Proof. By shifting the summation parameter we can assume, without loss of generality, 
that 1 < \x\ < q~ x . The series Y^=\ ls absolutely convergent for \z\ < 1. Let us assume 
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for the moment that \qbt . . . b k \ < \xq n ai . . . a k+ t\ for n < 0, then the analytic continuation 
of the r +i<^ r -series in the summand for \xq n \ > 1 is given by 



at,... , a k+1 n 
V bt,... ,b k 

(a 2 , • • • , a k+1 , bt/a u ... , b k /at, a x xq n , q 1 - n /a 1 x; q) 



(3.1) (h, ... ,b k , a 2 /at, ... , a k+1 /at, xq n , q 1 n /x; q) 

( at, qat/bt, • • • , qat/b k g 1_n &i . . . b k 
x k+ t¥k , , ; q 



qat/a 2 ,... ,qat/a k+1 xat...a k+1 
+ idem(ai; a 2 , . . . , a k+l ), 

where idem(ai; a 2 , ■ ■ ■ , a/c+i) after an expression stands for the sum of k terms obtained 
from the previous expression by interchanging at with each a^, i = 2, 3, . . . , k + 1, see [4, 
(4.5.2)]. Note that (1.10) is the case k = 1 of (3.1). 

Using the theta product identity 

(3.2) {aq n ,q x - n la',q) O0 = (-^"V^^M/a^oo 

we see that the n-dependence in (3.1) simplifies. Indeed, since 

(aixg n ,Q 1 ~ n /aia:;Q) 00 _ _ n (aix, g/aix; <?)oo 
y 6 - 6 ) 7Z~^. „i-«. /„. 3 ~ a i 



( xg n j(? i n/rj-.q^ (x,q/x;q)cv 

the sum Xln=-oo °f the ^ rs ^ term in the right hand side of (3.1) times z n is absolutely con- 
vergent for |z/ai| > 1. Hence, the sum is absolutely convergent for max(|ai|, . . . , |afc+i|) < 
\z\ < 1. 

Next we split the sum J2^=t + Sn=-oo' usm S the series for the fc+i^fc-series in the 
first sum and (3.1) in the second sum. Interchanging summations we see from (3.3) that 
the sums over n are all geometric. So we see that the left hand side of the lemma equals 



oo 



(at,... ,a k+1 ;q)j (qx) 3 

z 



y 

(q,bt,... ,b k ;q)j 1 - q*z 
(a 2 ,... ,a k+1 ,bt/at, . . . ,b k /at,atx,q/atx;q), 



(3.4) (bt, ■ ■ ■ , b k , a 2 /at, ... , a k+1 /at, x, q/x; q)^ 

\ - \<n_, i / "i </« i / • </; ; I >l"\ •••"/, 

X 

3 



E (at 1 qai/bt, ■ ■ ■ ,qat/b k ;q)j ( qbt ■ ■ -b k \ 



— ^ (q,qat/a 2 , ... ,qat/a k+1 ;q)j \xat...a k+1 J l-atq j /z 
+idem(ai; a 2 , • • • ,a k+1 ). 



10 



ERIK KOELINK AND HJALMAR ROSENGREN 



The sums in (3.4) can be written as k+2 ip k+ i-seTies. The first sum in (3.4) equals 



Ol, . . . , Clfc+l, z 

k+2<Pk+l I , , ;q,qx ) = 



z-1 \ bi, . . . ,b k ,qz 

z (ai, . . . , Ok+u bi/z,... , b k /z, q, xqz, 1/xz; q)^ 
z-1 ... , 6 fc , ai/z, ... , ajg+i/z, qz, xq, 1/x; q)^ 
(3.5) | z (a 2 , ■ ■ ■ , afc+i, &i/ai, ■ ■ ■ , h/au aixq, 1/aix, z, qz/ai; q) c 

z-1 (bi, ... ,bk, a 2 /ai, . . . , a fc+ i/ai, xg, gz, zja\\ q)^ 
f ai, qai/h, . . . , qai/bk, a\jz qb\... b k 

x A^y^+i , / / ; q-, 



K qai/a 2 , ■ ■ ■ , qai/a k +i, qa x j z" ' xai . . .a fc+ i 
+idem(ai;a 2 , • • • , a k +i), 



where we have used [4, (4.5.2)], cf. (3.1), once again. (The first fc+2<^fc+i-series reduces to 
1, since an upper parameter is equal to 1.) The k + 1 fc + 2</?fc+i-series in (3.5) are the same 
as in (3.4), and a simple calculation reveals that they occur with opposite coefficients. 
Hence, using (3.5) in (3.4) leaves only the first term on the right hand side of (3.5). This 
proves the result for the condition \qb± . . . b k \ < \xq n ai . . . a k+ i | for n < 0, and the general 
case follows by analytic continuation in the parameters of the jt+i^fc-series. □ 

Proof of Proposition 3.1. The sum Yl™=o m & * s absolutely convergent for \z\ < 1. As 
in the proof of Lemma 3.3 we can use (3.1) for k = 1 twice to see that the sum Y2n=-<x 
in S is absolutely convergent for \z\ > max(|od|, \ae\, \bd\, \be\). For n large enough we 
have \xq n \, \yq n \ < 1, so let us assume first \x\ < 1 and \y\ < 1. We can use the series 
representation (1.3) twice to write 
(3.6) 



a,b \ (d,e \ _ (d,e;q) k k ( a,b,q k ,q x k /f _ qfx 
c ' ' J 2 1 V / ' ' / ^(9,/;?)fc 4 3 \c,q 1 - k /d,q 1 - k /e' ' dey 



cf. Rahman's proof in [8, App. B]. The terminating 4^3-series in the summand in (3.6) is 
balanced for abde = cf and dey = fx, the assumptions in the proposition. Hence it can 
be transformed into a terminating very-well-poised sW-Vseries, see (1.12) for the notation, 
by [4, (111.19)]. It follows that (3.6) equals 



f a ^ (e,ab,bd;q) k k ,abd f _ k fc-1 qd. 



The gWyseries in (3.7) can be rewritten as a sum of two non-terminating %Wi- 
series using Bailey's three-term transformation [4, (III. 37) with (a, 6, c, d, e, /) replaced 
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by (afq k /e, adq k , aq/c, q/e, a, //e)]. Recalling that abde = cf we find 

(afq k , q k+1 f/e, aq k+1 , eq k , c/a, c/b, d; q)^ ,afq k k aq q f k , 
(3 - 8) (afqWfcqU 8 W 7 (—,adq,-,-,a,-,q,beq)- 

(fq k ,aeq k ,q k+1 ,c,bd,c/ab,ad;q) ao ,abd f _ k k _ x qd, 

— — — r 8^7 { ;a,b,-,q ,q cf;q,—) 

[abd^qjoo q e } 

ed (edq/f, cdq k , adeq k , dq k+1 , cq k+1 /b, q/e, a, f/e, b, dq 1 ~ k /f, q k f/d; q)^ 

f (qf/de, fcq k /e 7 qd/f, q 1 ~ k /e, cdq k+1 /b; q)^ 

dccj^*' do Q c 

x 8 W 7 (^-;adq k ,^,j ) ,d,-;q,beq k ). 

Note that the other two s^V-series in (3.8) are obtained from each other by interchanging 
(a, b, c, x) with (d, e, /, y). Using (3.8) in (3.7) and recalling that abde = cf and dey = fx 
leads to the following expression for (3.6); 

(3 9) V" y k ( abd( l k , a f<l k , Q h+1 f/e, aq k+1 , e, c/a, c/b, d; q)^ 
^ (f,aeq k ,q,c,bdq k ,c/ab,adq k ,afq k+1 /e;q) OQ 

W 7 ( ;adq k , —, -,a, -;q, beq k ) + Idem ((a, b, c, x); (d,e,f, y)) 



k=0 

x 



c e 



where Idem ((a, b, c, x); (d, e, f, y)) means that we have the same sum with the parameter 
sets (a, b, c, x) and (d, e, f, y) interchanged. 

Since we assume \y\ < 1 and \be\ < 1 the double series in (3.9) is absolutely convergent. 
Interchanging summations and recalling abde = cf shows that 

( a,b \ ( d, e 
(3.10) 2 <fii ( c ;q,x)2<fi[ j ;q,y 



V(fe)- 7 ' ^' c ^ a ' - a f qJ ' q3+1 f/ e ' a( i J+1 i abd Q J 'i q)oo ( aa / c i q/ e , a , // e ; qh 

Z - ' ' (/, q, c, c/ab, ae, bd, afqi/e, adqi; g)oo (q, fq/de; q)^ 



a fq 2 \ ( q,ae,bd,afqi/e,adqi,afq 1+2 i/e 



oo 

j=o 

e \abdqi,afqi, qJ +1 f/e, aqJ +1 , afq^/e 

+ Idem((a, b, c, x); (d, e, f, y)) 

assuming that abde = cf, dey = fx, \x\ < 1, \y\ < 1, and \be\ < 1. As a function of y the 
left hand side has a unique analytic continuation to C\(R>i U jM>i). The y-dependence 
in the first sum on the right hand side is only at the argument spot of the 6925-series, which 
has a unique analytic continuation to C\R>i. As j — > 00 the 6^5-series tends to 1, so the 
convergence with respect to y in the right hand side of (3.10) is uniform on compact sets. 
Similarly, the 6</?5-series in the other sum has a unique analytic extension to C\(^R>i). 
Hence (3.10) remains valid for y E C\(R>i U ^R>i) after using the analytic continuation 
of the 2^1" an d 6V ? 5 _ser i es - I* 1 particular, this means that (3.10) is valid for abde = cf, 
dey = fx, \be\ < 1 and y E C\(R>i U ^R>i). 
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To prove the result we replace x and y by xq n and yq n in (3.10), multiply by z n and 
sum over n G Z. If we assume for the moment that max(g, \ae\, \bd\, \ad\, \af/e\, \cd/b\) < 
\z\ < 1, then we can interchange summations and use Lemma 3.3 twice to sum the inner 
sum. Some cancellation occurs and after using the theta product identity (3.2) twice we 
see that S equals 
(3.11) 

(e, c/a, c/b, d, yz, q/yz, q; q)^ 
(/, c, c/ab, z, q/z, ae/z, bd/z, y, q/y, q)co 

be \ j n a fq 2j \ (aq/c, q/e, a, f/e; q)j (abdq J /z, afq J /z, fq J+1 /ez, aq J+1 /z; q)^ 



x 
j 



■ ' " 1 (q,fq/de;q)j (afq* /ez,adq3 /z;q)oo 

+Idem((a, b, c, x); (d, e, /, y)) 

(e,c/a,c/b,d,q,yz,q/yz,abd/z,af/z,qf/ez,aq/z;q)oo ,af aq q f ad be, 

W7 { — ; — , -, a, -, — ;q, —) 



(/ ', c, c/a6, y, g/y, z, q/z, ae/z, bd/z, qaf/ze, ad/ z^q)^ ze ' c'e' 'e 

+Idem((a, 6, c, x); (d, e, /, y)). 

For q < \z\ we can use [4, (III. 23)] using abde = cf to transform the s^V-series in the 
required form. Finally, use analytic continuation in z to find the result. □ 

Remark 3.4- (i) A proposition of this type has been proved first by Mizan Rahman for 
two special cases, see [8, App. B]. To see how the two special cases are contained in the 
result we consider it in the form (3.11). To the first s^V-series we apply [4, (III. 37) with 
(a, 6, c, d, e, /) replaced by (af / ze, ad/ z, aq/c, f /e,a, q/e)] to write it as a sum of two very- 
well-poised s^Vseries, of which the second is the same s^V-series as the second in (3.11). 
It turns out that we can add the coefficients using the theta product identity as in [4, 
Exerc. 2.16 with (x, A, \i, v) replaced by (y/xyz, ^xz/y, \fefjdz, yjx/yz)}. This yields 

(3 12) S = — - e ' ahd / z ' f/ z ' °^Slll b ^Slli l/y z 'i W,( abd - a b - - —-qd) 
(f,z,ad/z,bd/z,e/z,qd/ f,qc/e,y,q/y;q)oo 8 7 / ' ' ' e' z f ' 

(q, a, b, f/e, qde/f, qd/z, cd/z, ade/z, cq/bz, ey, q/ey, xz/e, qe/xz; q)^ 

(c, /, ad/z, bd/z, ae/z, qd/ f, cdq/bz, y, q/y, x, q/x, z/e, qe/z; q)^ 

TTr ,cd , dq q c ad fee. 
x sW 7 { — ;d,— ;q,—) 
bz j b b z z 

valid for \d\ < 1 and on any subregion of max(|od|, \ae\, \bd\, \be\) < \z\ < 1 in the complex 
z-plane as long as the right hand side is analytic in this subregion. The first case proved by 
Mizan Rahman [8, App. B.l] corresponds to / = qz in (3.12), so that the first sW'Vseries 
reduces to 1, and the second case proved by Mizan Rahman [8, App. B.3] corresponds to 
ey G q z in (3.12), so that the second term vanishes. 

(ii) The proof of Proposition 3.1 is inspired by Rahman's method as presented in [8, 
§B.3], but is of a different nature. In Rahman's case the balanced 4 <^ 3 -series is written as a 
(/-integral using [4, (2.10.19)], which is a three-term transformation for balanced 4923-series. 
In this paper we use Bailey's three-term transformation [4, (2.11.1)] for very-well-poised 
8^7-series, which can be deduced from [4, (2.10.19)]. Note that the result as a sum of two 
very- well-poised series cannot be simplified. 
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(iii) Note that (3.11) and (3.12) give alternative expressions for the sum S of Propo- 
sition 3.1, and together with the obvious symmetries in S we find more expressions for S 
in terms of a sum of two very-well-poised s^Vseries. We can also rewrite the result as a 
sum of three balanced 4</?3-series as follows. Start with (3.12) with (a, 6, c, x) <-> (d, e, /, y), 
apply [4, (III. 36) with (a,b,c,d,e, f) replaced by (ade/c,q/b,f/z,d,e,qz/c)] to the first 
gWVseries to write it as a sum of two balanced 4</?3-series and apply [4, (III. 36) with 
(a, 6, c, d, e, /) replaced by (af/ez, q/e, f/e, aq/c, a, ad/ z)] to the second s^V-series to write 
it as a sum of two balanced 4</?3-series of which one also occurs in the previous transfor- 
mation. The balanced 4</?3-series can be taken together using the theta product identity 
[4, Exerc. 2.16 with (x, A, /i, v) replaced by (^/bxz/a, a/ axz/b, a/ abx/z, a/ yz/c)] resulting 
in the following expression: 
(3.13) 

(q,a,b,c/ 'z,xz,q/xz;q)oo ( d,e,z,qz/c 



(c, z, a/z, b/z, x, q/x; q)^ 4</?3 \ /, qz/b, qz/a ' ^ Q 

(q,d,b,c/a,af /z,e,ax,q/ax,yz/a,qa/yz;q)oo (a,qajc,adjz,aejz 
(c, /, b/a, z/a, ad/z, ae/z, x, q/x, y, q/y; q)^ 4</?3 \ qa/b, qaj z, af / z ' ^ q 
^ (q, d, a, c/b, bf/z, e, bx, q/bx, yz/b, qb/yz; q)^ fb,qb/c,bd/ 'z,be/ 'z _ \ 
{c,f,a/b,z/b,bd/zM/z,x,<l/x,y,<l/y;<i)oo 4 3 V ob/a,qb/z,bf /z ' ' / 



valid on any subregion of max(|ad|, |ae|, \ bd\, \be\) < \z\ < 1 in the complex z-plane as long 
as the right hand side is analytic in this subregion. 

As observed the case ey G q z is special, and we see later that this case corresponds 
to the infinite set of discrete mass points in the spectral measure dv of the little g-Jacobi 
function transform. However, ey = q x ~ l with / — > 00 violates the conditions for absolute 
convergence of S as given in Proposition 3.1, so we have to deal with this case separately. 
Using Heine's transformation [4, (III.l)] we see in this case 



(3.14) 



d c 

2V1 ( j ■ <l- .'/'/' 



(f,yq n ;q)oo 

(d.q^+^q) 



2<Pl 



■2<fl 



f/d, yq 

eyq n 
f/d, yq 



A-l+n 



;q,d 
;q,d 



initially for \yq n \ < 1 and by analytic continuation in y to the general case for n £ Z and 
y G C\M>o. Note that the right hand side of (3.14) displays g-Bessel coefficient behaviour, 
which means that for I > n the series on the right hand side of (3.14) starts at I — n, see 
the proof of Proposition 3.5. 

We now prove the necessary result in some greater generality. 
Proposition 3.5. Let max(|ya|, \yb\) < \z\ < 1, \y\ < 1, x G C\M >0 and \qcd\ < \xab\, 
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then 

k ( a > b (g fc+1 ;g)oo f dq k ,e \ 

(q,b,c/a,dz/a,ax,q/ax,eya/z;q)oo ( a,aq/ 'c,aq/ 'dz,ya/ 'z qcd 
(d,c,b/a, z/a,x,q/x,ya/ 2; (7)00 \ aq/b, aqj z, eya/ z ' ^' xab 

(q,a,c/b,dz/b,bx,q/bx,eyb/ z]q)oo (b,bqjc,bqjdz,ybjz qcd 
(d,c, a/b, z/b,x,q/x,yb/z;q)oo 4< ^ 3 \ bq/a,bq/z,eyb/z xab 
| (q,a,b,c/ 'z,zx,q/ 'zx.ey^q)^ / z, zq/c,q/d,y _ g«A 



Remark. The conditions for Proposition 2.1 are less severe than in Proposition 3.1. How- 
ever, if we want the three 4</?3-series to be balanced we need the extra conditions cd = xab 
and abq = cde. 

Proof. As k — > oo, the summand is 0(1), so we need \z\ < 1 for absolute convergence. As 
k — > — oo the first 2 </ ; 'i- ser i es behaves like Cia~ k + C 2 b~ h by (3.1) for = 1 and for the 
second 2 ¥?i-series we use its g-Bessel coefficient behaviour; for k < 

(? fc+1 ;?)oo fdq k ,e \ ^ (g 1+fc+j ;g)oo(e;g)^ J 

(d,a k +i: a)„„(a: a), 

j=-k 



(dq k ;q)oo 2(Pl V 9 fc+1 V (dQ k+i ;q)oo(q;q)j V 



(g 1+p ;g)oo(e;g) P -fc p _ fc = (g;g)oo(e; g)-fc -fc 2V?1 f 69 k ■ q y 
^ (dqP;q) 00 (q;q) p - k (d; q)oo(q; q)-k 2 \ g 1_fc 



which is 0(y~ k ) as — > — oo. So the sum is absolutely convergent as /c — > — oo for |z| > |ya| 
and |z| > |y&|. 

Let T be the sum, then interchanging summation over k and the summation for the 
series representation of the g-Bessel coefficient gives 



oo oo 



j=0 fc=-j 



c / (d5 fc+ J';g)oo / (g;g) 



Consider the inner sum, say T J7 for j fixed. Shifting the summation parameter and using 
the series representation for the 2 y?i-series gives 

T = y z -j i^hlk x i q -ji y (q 1+p ^)^ z p q vi = z -j {q^qU ^ ( a ^ z . q , xq -j 

3 ( c ^'^)i j^Q (dqP-^q)^ ' (d, z^q)^ \c,dz J 

using the (/-binomial theorem. This is only valid for Ixg - - 7 ! < 1, but since the sum is 
uniformly convergent on compacta, Tj is analytic in x G C\R>o, so the result remains 
valid using the unique analytic continuation of the 3^2-series to C\R>o. 
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So this gives 



f 3^2 , ;q,xq 3 



where we assume that we use the unique analytic continuation for the 3^2-series. Since 
x G C\M>o and \qcd\ < \xab\ we have for all j > 0, 

fa,b,z _A _ ■ (a,b,c/ 'z,d,zx,q/ 'zx^q)^ fz,zq/c,q/d_ q 1+j cd 
3 ^ 2 \c,dz^' ^ J (c,dz,a/z,b/z,x,q/x;q) O0 3 '^ 2 \zq/a,zq/b , ^ J xab 
j(b, z,c/a,dz/a,ax,q/ax;q)oo (a,aq/c,aq/dz q 1+J cd 



(c, dz,b/a, z/a, x, q/x; q)oo 3< ^ 2 \ aq/b,aq/z ' ^' xab 

Aa,z,c/b,dz/b,bx,q/bx;q)oo I b,bq/ 'c,bq/ ' dz q 1+J cd 
—/ — 1 71 — 71 7 \ 3<^2 , , , , ; q 



(c, dz, a/b, z/b 7 x, q/x; q)oo \ bq/a 7 bq/z ' ' xab 

using (3.1) and the theta product identity (3.2). Using this in (3.15) and the (/-binomial 
theorem three times gives the result. □ 

Corollary 3.6. Let S be the sum in Proposition 3.1 and assume ey = q x ~ l fori G Z, then 
the series is absolutely convergent for \da\,\db\ < \z\ < 1. Assuming moreover abde = cf 
and fx = dey we have that S equals the sum of three balanced 4</?3 -series; 

s _ {q.a.b.c/z.zx.q/zx-.q)^ ( z, zq/c.q 1 ' 1 /y,d _ 
(z.c.a/z.b/z.x.q/x-.q)^ 4 3 \ zq/a,zq/b,f ' ' 
(d, q, b,c/a, zyq l /a, ax, q/ax, fa/ z; q)^ , z ,1 ( a,aq/c, aq x ~ l /yz, ad/ z 
(f,yq l ,c,b/a,z/a,x,q/x,da/z;q)oo ^a' 4 ^ 3 \ aq/b,aq/z,af /z 
| (d,q,a,c/b,zyq l /b,bx,q/bx 7 fbj 'z^q)^ ,zy / b.bq/c.bq 1 ' 1 /yz,bd/ * _ \ 
{f,yq\c,a/b,z/b,x,q/x,db/z;q) 00 V 4 3 \ bq/ a,bq/ z,bf / z ' ' / 



Remark. Note that putting e = q x ~ l /y in the expression (3.13) for S gives the same result 
using (3.2). Hence, the expressions for S derived in Proposition 3.1, (3.11), (3.12) and 
(3.13) remain valid in the case ey G q z . 

Proof. Use (3.14) in S as in Proposition 3.1, shift the summation parameter k = n — /, 
and apply Proposition 3.5 with x 1— > xq , e 1— > / / 'd, d 1— > y 1— > d and use the theta 
product identity (3.2) to find an explicit expression for S 1 as a sum of three 4</?3-series for 
I da |, \db\ < \z\ < 1, |d| < 1, x G C\M>o, |aq/| < |xa&|. Under the conditions a&de = c/ and 
fx = dey we see that these 4</?3-series are the balanced 4^3-series as stated. The condition 
|d| < 1 can be removed by analytic continuation in d. □ 

Proof of Theorem 2.1. We start off with the general dual transmutation kernel as in (2.1) 
assuming \a\, |r| > 1. This sum is of the type as considered in Proposition 3.1, and the 
conditions in Proposition 3.1 lead to ad = be and adx/c — by, or ad — be and x = y. We put 
c = aq a and d = bq a , and we apply Proposition 3.1 with a 1— > aq a /r, b 1— > aq a r, c 1— > abq 2a , 
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d I— > b/a, e i— > 6a, / i— > a&, x i— > —bx/a, y i— > — y and 2; 1— > a&t. This gives the required 
expression for the dual transmutation kernel under the conditions |a6q ,a ar| < \abt\ < 1 
and q < ab\t\, t <£ a 2 q 2a+z >\ t £ b 2 q 2a+z >°. 

The previous paragraph deals with the case A G [—1, 1], or a = e . For the discrete 
mass points we first consider o\ = —q 1 ~ l /by, I G Z such that \o~i\ > 1. Corollary 3.6 then 
applies, since b < 1, \ai\ > 1, q a ab < \abt\ < 1. From the remark following Corollary 3.6 
we see that the expression for the dual transmutation kernel remains valid for this set of 
discrete mass points of dv{-;a,b;y;q). The (possibly empty) set of discrete mass points of 
the form 01 = aq , / G Z>o such that \ai\ > 1, make one of the 2¥ 7 i _ser i es terminating after 
using the symmetry described in Remark 3.2, and the result for the dual transmutation 
kernel remains valid. This proves the first statement of Theorem 2.1. 

We now investigate when {t k 4> fl (xq k ; c, d; q)}kei £ H(a, 6; y). From (1.2) and (1.5) we 
see that we need the condition \t 2 ab\ < 1 for convergence as k — > 00. For k — > —00 we use 
the theta product identity (3.2) to find 

(3 16) (ab) k <y ~ byqk / a;q ^ 00 - a 2k ^~ ql ~^ y; ( - ^/ a > -aq/by; q)oo 



(-yq h ;q)°o (-q 1 k a/by;q) QO (-y, -q/y; q)^ 

which is 0(a 2k ) as k — > —00. The asymptotic behaviour of the little g-Jacobi function as 
\x\ — > 00 on a (/-grid follows from the expansion (1.10); for — > —00 

0((|) fc ), M = i, 

(3.17) t k <j> tl (xq k ;c,d;q) = { 0{(±) k ), |r| > 1, c(r; c, d, x; q) ^ 0, 

G((^) fc ), M > 1, c(t; c, d, g) = 0. 



c 

This implies that for generic /U we need \t 2 r~ 2 c~ 2 a 2 \ > 1 for convergence of (1.5) as 
k — > — 00. We conclude 

(3.18) |-| < 1*1 <^=^{^(^^;?)}we%^). 

Under the assumption of (3.18) the L 2 -theory for the little g-Jacobi function transform 
implies that the sum in (2.1) converges in L 2 (dz/(-; a, 6; y; (/)). In the special case c = aq a 1 
d = bq a , x = —bx/a, the conditions (3.18) are implied by abq a \r\ < ab\t\ < 1, since 
< ab < 1. Hence, P t (-, /U; q a ; a, 6) G L 2 (dv{-; a, 6; y; g)) for q ,a |r| < |t| < l/y/ab. 
Assuming \q a r\ < \t\ < l/y/ab we find from (1.8) 



t k ^^(yq k ;aq a ,bq a ;q) = / 4> x (yq k ;a,b;q) P t (A, //; a, 6) dv(\;a,b;y;q). 

Jm. 

Taking linear combinations shows that for v = {vk}ke% with only finitely many non-zero 
coefficients, we have 

(3.19) F aq <*M a ,y [ S t v] (ft) = / F a ,b,y l-> q 2akv k\ (A) Pt{\ W q a ; «, b) dv(X; a, b; y; q), 

Jr 
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using the notation as in (1.9). Again using the L 2 -theory of (1.8), (3.19) remains valid 
for {q 2ka Vk}k £ H{a,b;y), since this makes the integrand integrable with respect to 
du(-; a, b; y; q). Now we take Vk = s k t~ k (f) u (yq k ]aq a+ ^ ,bq a+ ^;q), which gives the prod- 
uct formula. This is valid for \q a+ @p\ < \q 2a s/t\ < \j\fah by (3.18), where v = |(p + p _1 ) 
with \p\ > 1. Note that these two conditions on s and t imply \abq 2a+ P pr\ < \abq 2a s\ < 1, 
which are precisely the conditions for the absolute convergence of the left hand side of 
(3.19), cf. (2.1). □ 

4. The transmutation kernel 

In this section we prove Theorem 2.2. The results in this section give another point 
of view to Gasper's results [3] on (/-analogues of Erdelyi's fractional integrals, see also §5. 
Rewriting Gasper's (/-analogue [3, (1.8)] of Erdelyi's fractional integral gives 

(4i) 2 <pi ( ara ' ar / a . q b y^\ _ ( a ^ rg ;g)oo y\ a ft)fc (q k+1 ,- b yq k+l / a ;q)oo 

\ abrs ' ar J (q, abrs; q)^ ^ (rsq k ,—byq k+l /ar;q) QO 

( q~ k ,r,ar/b \ faa,a/a byq l+k 

x 3^2 i-i-k/h ) 2^1 . 

yrSj—arq 1 1 K /by J \ ab a 

for \rs\ < 1, \ab\ < 1. In §5, see Theorem 2.3(h), we give an alternative derivation of 

(4.1) using intertwining operators for the second order (/-difference operator L as in (1.1). 
Indeed, as remarked in §2, (2.2) is equivalent to (4.1). We can also prove (4.1) using the 
connection coefficient formula 

(4.2) (6a, b/a- q) m = (ab, q) m g (g> j^jf ^ g)fc (^ ^ 

which is the (/-Saalschiitz summation formula [4, (11.12)]. So (4.1) links two little q- 
Jacobi functions with different parameters sets, but with related argument. Without this 
condition on the arguments we have not been able to find a simple expression for the 
kernel, even if we allow the summation parameter to run over Z instead of Z>q. 

Note that (4.1) may be viewed as a connection coefficient problem for two sets of 
orthogonal functions. Having in mind the limit transition of Askey- Wilson polynomials to 
little (/-Jacobi functions, see [9, §§2.3, 4.1, 6.1], we see that (4.1) can be viewed as the limit 
case of the connection coefficient problem for Askey- Wilson polynomials, see [2, §6]. 

In case s = 1 the 3^2-series in (4.1) reduces to a terminating 2¥?i-series that can be 
summed by the g-Chu-Vandermonde summation [4, (II. 6)] yielding 

f ara,ar/a byq l \ (ab,r,-yq l ;q) c 

(4.3) 2V1 l ; 9, 



abr ' ar J (q, abr, —byq 1 /ar; q) c 



k (q k+1 ,-byq k+l /a^q)^ (aa,a/a_ byq l+k 



; ; , (/•(/•. ■yq k+l ;q) < \ ab a 



2^1 l 
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which is equivalent to, by [4, (1.4.6)], 
(4-4) 

fba,b/a A (a&,r; g)oo ^ n fc (g fc+1 ;9)oo fba,b/a l+k 

valid for y e C\M>o. This can be proved easily using the (/-binomial theorem. See also 
(5.7) and (5.13) for similar results. Another interesting case of (4.1) is r = 1, which reduces 
the 3</? 2 -series to 1. This gives (4.4) after renaming. In §5, see Theorem 2.3, we show that 
(4.1) can be derived from (4.4). 

Proof of Theorem 2.2. Fix y and define u = {uk)kei by 

_ / b \-l (°fr> ra ;g)oo (g fc ~' + \-?/9 fc ;9)oo ( q l ~ k ,r,ar/b 

k (q, abrs; q)^ (rsq k ~ l , —byq k /ar; q)^ 3< ^ 2 \rs,—arq 1 ~ k /by'^ 1< ^ 

with the convention Uk = for k < I. Using [4, (III. 12)] the 3 </? 2 -series can be written as 

q l ~ h ,r,ar/b \ (—yq l ;q)k-i fq l ~ k 1 ar/b,s byq k 



yrSj—arq 1 K jby J {—byq l /ar;q)k-i \ rs,—yq l a 

so that -Ufc = 0(1) as k — > oo. It follows that u G H(a,b;y). Then (4.1) states that the 
little g-Jacobi transform of it, see (1.8), is 

, w , fara.ar/a byq l \ 1 

{Fa,b,yU) (A) = A (yg /s;or, 6s; g) = 2 ^i I ^ ; <?, — —J, X = -{a + a ). 

By the inversion formula of (1.8) we find the result for the transmutation kernel as in 
Theorem 2.2. 

Note that we can write 

(4.5) Mabrs) 1 ——-±- °° P M (a, b, y; r, s) = (^~l, y ^ar,bs, y /su) k 

l=-oo 1 yq/s.qjoo 



valid for u = {uk}k having only finitely many non-zero coefficients. In particular, choosing 
v>l = Pi jP (ar,bs,y/s;t,u) for I < k and u\ = for / > k under the assumptions u, t > 0, 
\ut\ < 1 we find from (4.5) 

(4.6) p k,i( a > b, y; r, s)P), p (ar, bs, y/s; t, u) (abrs) 1 - hm 

;= _ oo I yq/s,q)oo 



p 



{FalyFar,bs,y/s[l ^ (^~] bs , y / a [A h-> </>A ( — J art , <?)] ,] ) fc 



which is the product formula. □ 
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If we plug the explicit expression for the transmutation kernel into the product 
formula, we obtain, after relabelling, the following expression. For k E Z, p E Z> , 
r, s, t, u > with rs < 1, tu < 1 we have 

(47) (tu; q) p -i f q l ~ p ,t,art/bs ^ \ (rs;q)i ( q~ l ,r,ar/b ^ 

(q;q) P -l 3 2 \tu,-artq 1+l - k /by 7 ' / 3 2 \rs, -arq 1 ^ /by' 

x ( rs )P-l t l (~ ar( l 1 ~ k / b y^)i = (rstu;q) p ( q~ p ,rt,art/b _ \ 
(—artq 1 ~ k /by; q)i (q;q)p \rstu, —artq l ~ k /by' ' / 

This product formula is equivalent to Gasper [3, (1.7)], and, as remarked in [3], (4.7) 
implies (4.1) in the limit p — > oo. Here we have shown that the converse is also valid, (4.1) 
implies (4.7) using the little (/-Jacobi function transform. 

5. Intertwining properties 

In this section we prove Theorem 2.3, and as a motivation we start by giving a Darboux 
factorisation of the second order (/-difference operator L( a ' 6 ) or C^ a ' b \ 

The backward (/-derivative operator is B q = M 1 / X (l — T" 1 ), where M g is the operator 
of multiplication by g; [M g f^(x) = g(x)f(x), and T q f(x) = f(qx), as introduced in §1. It 
is straightforward to check that 

/r- -,\ / n , / , s\, \ b(l — aa)(l — a/a) . . . . 

(5.1) (BM-, a, b; q)) (x) = -± A 1 ' <f> x (x; ag, 6; g). 

(/a(l — ao) 

Considering H(a, b; y) as an L 2 -space with discrete weights (ab) k (—byq k /a; q)oo/ (—yq k ', q)oo 
at the point yq k , fc 6 Z, we look at B 9 as a (densely defined unbounded) operator from 
H(a, b; y) to 7i(aq, b; y). Its adjoint, up to a constant depending only on y, is given by 

(5.2) A(a, b) = M 1+bx/aq - abM 1+x T q , 
and it's a straightforward calculation to show that 

(5.3) (A(a, b)<f>\(-; aq, b; q))(x) = (1 - ab) (/>\(x; a, b; q) 

and that —bL^ a,b ^ = aqA{a,b) o B q , with the notation as in (1.1). Since B q and A(a,b) 
are triangular with respect to the standard orthogonal basis of Dirac delta's at yq k of 
H{a,b;y), this means that we have a Darboux factorisation of L^ a ' b K Also, —b(L^ aq ^ + 
(1 -q)(l- qa 2 )) = aq 2 B q o A(a, 6), from which we deduce B q o L( a ' 6 ) = L^' 6 ) o B q and 
£(a>*0 o A(a,b) = A{a,b) o L^ aq ' b \ It is the purpose of this section to generalise these 
intertwining properties to arbitrary complex powers of B q . 

Introduce the operator W u , v E C, acting on functions defined on [0, oo) by 



(5.4) (WJ) (x) =x v jr / f(xq- l )q- lA -^- : x E [0, oo), 



1=0 
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assuming that the infinite sum is absolutely convergent if v ^ — Z> . So we want / 
sufficiently decreasing on a (/-grid tending to infinity, e.g. f(xq~ l ) = 0(q l( - u+£ ^) for some 
e > 0. Note that for v G Z< the sum in (5.4) is finite and Wo = Id and W-\ = B q . 

This operator is a (/-analogue of the Weyl fractional integral operator as used in [12, 
§3], [13, §5.3] for the Abel transform. With the notation 



/OO 
f(t)d q t = aJ2f(xQ- k )Q- k 
k=0 

for the (/-integral, cf. (1.6), we see that for n G N the operator W n is an iterated (/-integral; 

/>OG />OG />OG 

(5.5) (W n f){x)= I j ... j f(x n )d q x n d q x n - 1 ...d q x 1 . 

J X J X\ J I„_l 

In the following lemma we collect some results on W v , where we use the function space 

(5.6) ^ p = {/:[0,oo)^C| \f(xq- l )\ = 0(q l P), I - oo, Vxe(g,l]}, p > 0. 

Recall that £( a > & > is defined in (1.4). 

Lemma 5.1. Let v, p G C\Z<o- 

(i) W v preserves the space of compactly supported functions, 

(ii) W V :T P ^ F p -Mv for p > Uv > 0, 

(iii) W v oW^ = W v+Ii on T p for p>^{p + v)> 0, 

(iv) W u o B q = B q oW v = W v - X on T p for p > %tv - \ > 7 and B q l oW n = id for n G N 
on T p for p > n, 

(v) £( aq o W v = W v o C^ a,b \ valid for compactly supported functions. 
Remark. It follows from (iii) that W- n = B™, n G N, and W = id. 

Proof. The first statement is immediate from (5.4). For (ii) we use that for / G T p and 
x G ((/, 1] we have 

Mi. 



\W u f{xq- k )\ < MV^V (Hi) ^ ( ! U ' q)l = Mq k ^~^ , (g ^ g)o ° 

^ (g;g)z (^"^;g)c 



by the (/-binomial theorem for p > The third statement is a consequence of inter- 
changing summations, valid for / G T p , p > 3?(/i + z/), and 

k ^i p (q;q)k{q;q)i {q;q) P 

which is the (/-Chu-Vandermonde summation formula [4, (1.5.2)]. For (iv) we note that 
B q :Tp — > Fp+i, then the first statement of (iv) is a simple calculation involving (/-shifted 
factorials, which reduces the second statement of (iv) to verifying the easy case n = 1. For 
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(v) recall (1.4), so that C^ aq ~^ b \W u f){x) and W V {C^ f)(x) involve the values f(xq~ k ), 
k + 1 G Z> . A straightforward calculation using (/-shifted factorials shows that the 
coefficients of f(xq~ k ) in C^ aq ~" ' b \W v f)(x) and ^(£( a > & )/)(x) are equal. □ 

The asymptotically free solution <& a {yq k ; a, 6; q) G T p for (/ p > |aa| as follows from 
(1.10). A calculation using the (/-binomial formula gives, cf. (4.4), 

(5.7) (W„<M.; «. *! «))(v«*) = y" , ( _ g J g >°° $ g ( yg * ; 6; (/), 

[ciq cr, QJoo 

for |aa| < q v in accordance with Lemma 5.1(v). Note that (5.7) is a (/-analogue of Bate- 
man's formula, cf. [3], [12]. 

Lemma 5.2. Define the operator 

S(a, b) = M (_„,,) o T b/a , T b/a f(x) = f(-x), 

thenS(a,b)- 1 oC( a ' b ')oS(a,b) = C^ b ' a K /n particular ; wj) a ' b) = S(a, bq~ v ) o W v o S(a, b)' 1 
satisfies the intertwining property C^ a,bq ) o w!) a,b ^ = w!) a,b ^ o £( a ' 6 ). 

Note that S^a, 6) _1 = S(b, a) and that S(a, b):H(b, a; yb/a) — > 7i(a, 6; y) is an isomet- 
ric isomorphism. For / G T p we see that (S(a,b)f)(xq~ l ) = 0(\a/b\ l q lp ) from (3.2), so 

that S(a,b)f G .7>|-ln(|a/6|)/lng- 

Proof. It follows from (1.4) that 

£W, <*~F£)& /(a!))(a!) = 



(-x;g) c 



(-bx/a;q) t 



and the term in parentheses can be written as T & / a o £( & > a ) o T a / b applied to /. The second 
statement then follows from Lemma 5.1(v). □ 

It follows directly from (1.2), (1.10) and [4, (1.4.6)] that 

(S(a,b)(j>x(-;b,a;q))(x) = <f>\(x;a,b;q), 

(5.8) 

(S(a,b)<$> a (-;b,a;q))(x) = <$> a (x;a,b;q). 

Proof of the first statement of Theorem 2.3. It follows from Lemma 5.1(v) and Lemma 5.2 
that the operator 

W u ^(a,b) = W^~ v ^oW v 

= S{aq~ u , bq-v) oW^o S(b, aq~ v ) o W v 
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satisfies the required interwining property. For / e T p with p > $tv we can interchange 
summations, which leads to the sum with a terminating 3(^2 as kernel. Note that the 
3</?2-series in the kernel of W v ^(a, b) behaves as 

/ q-»,-q 1+ »-»a/bx u _h 
2Vi 1+u/ ]Q,q M - 

as p — > 00. 

The statement for the action on $ (T (-;a,6;g) follows immediately from (5.7) and 
(5.8). □ 

In order to prove the remaining half of Theorem 2.3 we take appropriate adjoints of 
the previous construction. Consider W u , v e C\Z< , as a densely defined unbounded 

operator from H(aq l/ ,b;y) to Ti.(a,b;y) and define as its adjoint, so 

(5-9) (R^f, 9)H{ftov) = </, ^>W(«,6;y) 

for all compactly supported functions (7, cf. Lemma 5.1 (i) . Here we use the identification 
of H(a,b;y) as a weighted L 2 -space on a discrete set, see §1. A (/-integration by parts 
shows 

1 } Kv J,{yq) {-byqP-v/a-qU^^ ' (q, -byqP , 'a; q) t 

Now define, for functions /, the operator 



(5.11) (Al^f)(x) = { -^°) q \ Y,f{xq l )(ab) 1 {q ^~ X ; q \ 

{-bxq v /ajgjoo f-^ (q,-bx/a;q)i 



so that Al a > b) 



y v Ri a,b \ Note that Ai a,b ^ is well-defined for bounded functions 



n(a,b-,y) 

assuming \ab\ < 1. Recall that the dense domain of finite linear combinations of the basis 
vectors for £( a ' 6 ) corresponds to the functions compactly supported in (0, 00). 

Lemma 5.3. C( aq '^oA^'^ = A^' 6 -* o£( a > & ) on the space of functions compactly supported 
in (0,oo). Moreover, 

(4^V A ( S a,M)(z) = ( ff ; f°° 0A(W,fr; g ). 

{ab; q)oo 

Defining Al a ' b) = S(a, bq v ) o A (b ' a) o S{b, a) we have C^ b ^ o A ( *' b) = A { „> h) o £( a > b ), and 
(i^V A (-;a,6;o))(x) = ( ff ; f °° </> A (x; a, 6g»; g). 
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Proof. Note that (5.10) and (5.11) show that the operators R^ ,b ^ and A^ ,h ^ preserve the 
space of functions compactly supported in (0, oo). The intertwining property for i?j> a ' b - ) 
follows from (5.9) and Lemma 5.1, and hence for Ai a,b K 

To calculate the action of Al a ' b ^ on the little g-Jacobi function we use [4, (1.4.6)] to 
write 

/e 10 v , , 7 \ (-x;q)oo fba,b/a 

(5.12) (p\{x;a,b;q) = — 2 <pi [ ;q,-x 

(-ox/a; g)oo \ ab 

Using this in (5.11), interchanging summations, which is easily justified for \x\ < 1, and 
using the (/-binomial theorem gives 

,rio\ (A(a,b)A/ l \\{ \ {abq",-x;q) 00 fba,b/a \ 

(5.13) K-VA(-;a,M))M= K _ fer/a;4 m( ^ ;q,-x) 

and using (5.12) again gives the result for |x| < 1. The general case follows by analytic 
continuation in x, see (1.10), (3.1), since the convergence in (5.11) for / the little g-Jacobi 
function is uniform on compact sets for x. 

The statements for Ai a,b ' follow from the corresponding statements for Ai a,b ^ and 
Lemma 5.2 and (5.8). □ 

Proof of the second statement of Theorem 2.3. Define 

4,,(a,6) = If^oiM 

= S(aq", bq") o Af aq ^ o S(b, aq v ) o A^ b) 

then it follows from Lemma 5.3 that the intertwining property is valid. The action on a 
function / can be calculated and for / compactly suppported in (0, oo) we find the explicit 
result with the 3</?2-series as kernel. We can extend the result to bounded / if we require 
v > 0. 

The action of A Utfl (a, b) on the little g-Jacobi function follows from Lemma 5.3. □ 

6. Quantum group theoretic interpretation 

The quantised universal enveloping algebra U q (su(l : 1)) has representations in £ 2 (Z> ) 
for the discrete series representations, and in £ 2 (Z) for the principal unitary series, the 
complementary series and strange series representations. For the harmonic analysis the 
so-called twisted primitive elements, as analogues of self-adjoint Lie algebra elements, play 
an important role, and in each of these representations they give rise to a three-term 
recurrence relations in which there is essentially one degree of freedom. In the discrete 
series representations the three-term recurrrence relations can be solved in terms of Al- 
Salam and Chihara polynomials [10], [15], and in the other series in terms of little g-Jacobi 
functions [8, §6]. 

The transition of the generalised basis of eigenvectors of two different twisted primitive 
elements in a strange series representation of U q (su(l : 1)) is given by the dual transmutation 
kernel of Theorem 2.1. For the complementary series and principal unitary series we can 
deduce the corresponding dual transmutation kernel from Proposition 3.1 in a similar way 
using other specialisations, cf. [8, §6, App. A]. For the discrete series representation we 
refer to [15] and [11]. 
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